📄 Text Chunking

Semantic Segmentation, Context Windows, Document Boundaries, Retrieval Units

Why Your Chunking Strategy Makes or Breaks Your AI System
medium.com·4d·
Discuss: Hacker News
📄Semantic Chunking
StoryGem: Voronoi treemap Approach for Semantics-Preserving Text Visualization
arxiv.org·1d
🔶Voronoi Diagrams
davidchisnall/igk: I got Knuth'd: A compiler for documents
github.com·7h
📝Concrete Syntax
Which Vision Language Models Should You Use for Your Apps
thenewstack.io·1d
🤖Advanced OCR
Why Your Next LLM Might Not Have A Tokenizer
towardsdatascience.com·18h
🤖Grammar Induction
Clustering News Articles for Topic Detection: A Technical Deep Dive
dev.to·3d·
Discuss: DEV
📚Document Clustering
June 25, 2025 Flight Tracking Workshop (4 hour) [Americas / Europe-friendly time]
bellingcat.com·14h
🧮Prolog Parsing
New: Improve Apache Iceberg query performance in Amazon S3 with sort and z-order compaction
aws.amazon.com·17h
🔄Burrows-Wheeler
ByteSpan: Information-Driven Subword Tokenisation
arxiv.org·1d
💾Binary Linguistics
Markov-Enhanced Clustering for Long Document Summarization: Tackling the 'Lost in the Middle' Challenge with Large Language Models
arxiv.org·1d
📥Feed Aggregation
Detecting Machine-Generated Texts: Not Just "AI vs Humans" and Explainability is Complicated
arxiv.org·10h
🧮Kolmogorov Complexity
Practical tips to optimize documentation for LLMs, AI agents, and chatbots
biel.ai·19h·
Discuss: Hacker News
🤖Archive Automation
What LLMs Know About Their Users
schneier.com·3h
💻Local LLMs
Portable Network Graphics (PNG) Specification (Third Edition)
w3.org·17h·
Discuss: Hacker News
🕸️WebP Analysis
The modern text processing pipeline: Overview
newroadoldway.com·1d·
Discuss: Lobsters, r/programming
🔤Unicode Normalization
Automattic/harper: Offline, privacy-first grammar checker. Fast, open-source, Rust-powered
github.com·1d
📝Concrete Syntax
PDF Retrieval Augmented Question Answering
arxiv.org·1d
📊Multi-vector RAG
How to sync Context across AI Assistants (ChatGPT, Claude, Perplexity...) in your browser
dev.to·21h·
Discuss: DEV
🖥️Modern Terminals
BPCLIP: A Bottom-up Image Quality Assessment from Distortion to Semantics Based on CLIP
arxiv.org·1d
🖼️JPEG XL
Semantic-Aware Parsing for Security Logs
arxiv.org·1d
📝Log Parsing